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MAXIMUM  LIKELIHOOD  ESTIMATION  FROM  RENEWAL  TESTING 


ABSTRACT 

This  report  considers  the  maximum  likelihood  estimates  of  life-time 
distributions  over  an  interval  [0,T)  from  the  following  time  truncated 
experiment.  At  time  zero,  the  beginning  of  the  testing  n(l  <  n  <  «)' 
items  are  put  on  test.  When  an  item  fails  it  is  replaced  and  at  time  T 
all  testing  is  stopped. 

Assumptions  about  tne  form  of  the  life-time  distribution  on  [0,T) 
are  required.  Distributions  considered  are: 

(1)  A  single  parameter  class  which  includes  the  Weibull  family; 

(2)  A  multiple  parameter  class  with  increasing  failure  rate  on 
[0,T);  and 

(3)  A  nonparametric  class  which  includes  the  increasing  failure 
rate  family. 

Useful  and  desirable  properties  of  the  maximum  likelihood  estimates 
are  s..own. 
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MAXIMUM  LIKELIHOOD  ESTIMATION  FROM  RENEWAL  TESTING 


1.  INTRODUCTION  AND  SUMMARY 

Based  on  a  number  of  practical  reasons  it  is  often  necessary  and 
even  desirable  in  life  testing  (reliability)  studies  to  fix  the  total 
testing  time,  say,  at  T  (?  <  «),  before  testing  begins.  For  example, 
an  experimenter  would  rarely  use  a  testing  p3an  that  did  not  limit  the 
total  testing  time  when  the  items  being  tested  can  be  assumed  very 
reliable,  since  the  testing  time  would  usually  be  very  long.  The 
total  testing  time  must,  also,  be  limited  if  project  deadlines  must  be 
met,  or  if  equipment  or  personnel  used  in  the  testing  can  only  be 
spared  for  some  specified  length  of  time. 

Limiting  the  total  testing  time  need  not,  however,  be  contrary 
to  the  goals  of  the  experimenter.  For  example,  if  the  experimenter 
can  assume  that  the  general  form  of  the  life-time  distribution  belongs 
to  some  parametric  class  defined  on  the  nonnegative  real  axis ,  then 
limiting  the  testing  time  to  T,  he  can  still  estimate  the  unknown 
parameters  of  the  distribution  on  [0,  ®). 

If  the  experimenter  cannot  assume  that  the  life-time  distribution 
has  a  particular  form  on  [0,  «)  but  only  on  [0,  T),  then  he  must  limit 
his  inferences  to  the  latter  interval.  However,  if  [0,  T)  includes 
the  mission  time  of  the  items  tested  then,  for  all  practical  purposes, 
he  need  not  infer  anything  about  the  distribution  outside  this  interval. 
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One  of  the  most  popular  time  truncated  testing  plans  is  the  subject 
of  this  report.  This  plan  stipulates  that  n  items  are  initially  put  on 
test  at  time  zero.  When  an  item  fails  it  is  replaced  by  a  new  item  ahd 
at  time  T  all  testing  is  stopped.  (For  convenience  this  plan  is  called 
"Testing  Plan  A.")  Renewing  a  failed  item  is  a  method  to  further  save 
experimental  time  and  generally  results  in  a  better  utilization  of 
equipment  and  personnel. 

Practically  all  of  the  statistical  procedures  developed  in  the 
literature  for  Testing  Plan  A  are  based  on  the  assumption  that  the  under¬ 
lying  life-time  distribution  of  the  items  tested  is  the  exponential  law 

G(x)  =  1  -  exp(-Ax),  ( 1 .1) 

A  >  0,  x  >  0.  (See  Epstein  [1959]  for  a  review  of  these  procedures.) 

In  practice,  however,  the  exponential  assumption  is  often  not  valid 
since  it  implies  a  no  wear-out  (or  no  aging)  property  of  the  items. 
Moreover,  if  the  times  to  failure  of  the  items  do  not  follow  the  law 
(l.l)  these  exponential  procedures  could  possibly  be  sensitive  to  this 
departure.  (See  Zelen  and  Dannemiller  [l96l].) 

For  Testing  Plan  A  this  report  investigates  the  maximum  likelihood 
estimates  of  life-time  distributions  from  three  general  classes.  Life¬ 
time  distributions  describing  wear-out  are  contained  in  each  of  these 
classes  and,  also,  each  class  contains  the  exponential  distribution. 

Specifically,  in  Section  3  the  maximum  likelihood  estimate  (MLE)  of 
the  parameter  A  will  be  considered  when  the  life-time  distribution  has  the 
form 

F(x)  =  1  -  exp(-Ag(x) ), 
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X  >  0,  0  <  x  <  T,  g(*)  is  a  known,  strictly  increasing,  differentiable 
function  on  [0,  T)  with  g(0)  =  0.  Observe  that  nothing  is  assumed  about 
F  on  [T,  »  ).  This  parametric  class  is  obviously  relevant  to  life  testing 
since,  for  example,  it  includes  the  exponential  (when  g(x)  »  x,  x  >  0),  the 
Weibull  (when  g(x)  *  x®,  8  >  0,  x  >  0)  and  the  extreme-value  distributions 
(when  g(x)  ■  eX  -  1,  x  >  0).  Asymptotic  distribution  theory,  which 

will  allow  one  to  test  hypothesis  on  the  true  value  of  X,  shall  be  given  along  i 

with  a  number  of  pleasant  properties  of  the  MLE.  These  results  do  not  depend 

on  the  fact  that  F  is  not  restricted  on  [T,  *  ) .  Also,  a  major  drawback  to  * 

another  method  of  estimating  X  shall  be  discussed.  ) 

As  such,  the  class  of  distributions  introduced  in  Section  4  has  not  been 
considered  in  the  literature.  Practical  applications  of  this  class  shall  be 
discussed  and  the  MLE's  of  parameters  determining  the  life-time  distributions 
over  (0,  T)  are  shown  to  be  asymptocially  normal  and  consistent. 

Often  an  experimenter  does  not  know  a  priori  that  the  law  governing  the 
times  to  failure  of  the  items  tested  belongs  to  a  certain  parametric  class. 

He  may,  however,  know  that  the  underlying  distribution  is  a  member  of  a  non- 
parametric  class  of  distribution,  e.g.,  the  Increasing  (Decreasing)  Failure 
Rate  (IFR  (DFR))  family. 

Marshall  and  Proschan  (1965)  considered  the  MLE  of  a  life-time  distribution, 
assuming  only  that  it  was  a  member  of  the  IFR  (DFR)  family  and  that  data  arise 
from  a  testing  plan  which  does  not  allow  censoring,  time-truncation  or  replace¬ 
ment.  Bray,  Crawford  and  Proschan  (1967),  also,  considered  the  MLE  of  a 
life-time  distribution  from  a  nonparametric  class  which  includes  both  the 
IFR  and  DFR  families.  The  testing  plan  they  introduced  allowed  for  the 
consideration  of  various  types  of  incomplete  data. 

Since  nonparametric  estimation  has  not  been  considered  in  the  literature 
for  Testing  Plan  A,  we  will  study  this  type  of  estimation  in  Section  5.  The 
class  of  distributions  considered  includes  the  IFR  family  and  the  main  result 
of  that  section  is  the  consistency  of  the  MLE  over  [0,  T).  : 
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2.  PRELIMINARIES 


In  this  section  preliminary  definitions  and  notations  needed  in  later 
sections  shall  he  collected.  For  completeness  we  give 

Definition  2.1  (Testing  Plan  A) 

At  time  zero,  the  beginning  of  the  testing,  n  new  items  from  a 
population  are  put  on  test.  When  an  item  fails  it  is  instantaneously 
replaced  with  a  new  item  from  the  original  population  and  at  time  T  the 
testing  is  stopped. 


Estimation  from  Testing  Plan  A  has  been  considered  by  several  authors, 
including  Epstein  (1959 »  page  3.17)  and  Gnedenko,  Belyayev  and  Solovyev 
(1969,  page  169),  when  the  life-time  distribution  of  the  items  is 
exponential.  These  authors  derived  the  likelihood  function  by  standard 
methods  which  could,  also,  be  used  for  other  classes  of  distributions 
with  densities.  In  the  present  approach,  however,  the  derivation  of 
the  likelihood  function  utilizes  the  theory  of  stopping  variables.  The 
benefits  of  this  approach  are  two-fold.  Firstly,  a  straightforward 
method  of  obtaining  the  likelihood  function  is  developed  for  the 
parametric  classes  of  distributions  considered  in  Sections  3  and  b. 
Finally,  this  approach  motivates  a  generalized  likelihood  function 
needed  in  Section  5  for  the  nonparametric  class. 

To  develop  this  preliminary  theory  observe  that  Testing  Plan  A  may 

be  considered  as  n  independent  experiments,  each  beginning  at  time  zero 

and  ending  at  time  T.  Throughout  this  report  Kr  will  denote  the  random 

number  of  items  put  on  test  in  the  r-th  experiment  and  X.  will  denote 

it 

the  time  to  failure  of  the  i-th  item  put  on  test  in  this  experiment, 

i=l,2,..,,r=l,...,n.  From  this  notation  we  have  that  K  is  the  first 

r 

integer  such  that 


l  *lr»*. 


i=l 


r— 1 , . . . ,  n . 


For  the  moment  consider  only  the  1-st  experiment  and  let  =  X^, 
i=l,2,. . , ,K=K^.  Also,  let  F  be  the  cumulative  distribution 


▼ 


-3WKX-- 


i 


function  (c.d.f.)  of  Xr  It  is  straightforward  to  show  that  if  F(0)  <  1 
then  K  is  exponentially  hounded;  i.e., 

Prob(K=k)  <_  cp\c  >0,  0  <  p  <  1,  1,2,..., 

This  implies  that  K  is  finite  with  probability  one  (w.pr.l)  and  all  moments 
of  K  exist.  Now,  let 

k-1 

*  {x^.  •  •  I  xi  <  T> 


and 

k-1  k 

8.  =  tx. ,. . .  ,x.  :  l  x.  <  T,  l  x  >  T} 
k  1  *1=1  i=l 

0 

k=l,2 .  (The  convention  that  sums  of  the  form  are  equal  to  0  and 

0  i=l 

products  of  the  form  n  are  equal  to  1  is  adopted  in  this  report.)  Since 

i=l 

K  <  «  w.pr.l,  one  may  show  that 


1 


y  f.  .  .  f  n  dF(x. ) . 

k=l  J  j  i=l  1 


(2.1) 


Let  be  the  time  on  test  of  the  i-th  item  put  on  test  in  the  r-th 

experiment,  i=l,2,. . .  ,r=l,. . .  ,n,  and  let  Y^=Y^,i=l,2 .  Observe,  now, 

that 


Y 


ir 


ir 


» 


i=l,...,Kr-l,  and 


Kr-1 


T-  Z  Xir. 


i=l 
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(2.2) 


(2.3) 


L 


r=l,...,n.  Since  the  testing  is  truncated  at  time  T,  experiment  1  is 
characterized  by  the  time  on  test  statistics  (Y1>...,Yk).  By  (2.2)  and 
(2.3)  one  sees  that  the  experiment  is  equivalently  characterized  by  the  times 
to  failure  (X^. . .  tX^). 

Nov,  in  almost  all  cases  where  the  c.d.f.  has  a  probability  density 
function  (p.d.f)  one  can  show  that  the  likelihood  function  is  derived  from 
the  integrand  of  an  expression  equated  to  1  and  where  the  integration  is 
over  the  sample  space  of  the  random  variables  of  interest.  For  (X^,... 
the  sample  space  is 


n,  -  U  a , 

1  k-1  K 


and  for  (X^,...,Xj,  ^)  the  sample  space  is 


n? "  U  V 

*  k-1  K 


We,  therefore,  integrate  out  x^  in  (2.1)  obtaining 


“  C  C  k-1  k-l 

1-  I  I.  .  .  I  [1-F({T-  l  x. }”)]  n  dF(x,), 

k-1  J  Ak  J  i=l  1  j=l  1 


where 


(2.U) 


F(x")  «  Um  F(x-e), 
e — >0 


e>0,x>0,  and  it  is  observed  that 

8.  —  { x. ,  • . .  ,x.  :  £  k.  *  T ,  x,  T  ■  £  x . } 

K  1  K  i-1  K  i=l 


K  -1 
r 


k-1 


k=l , 2 , . . . . 


Hence,  if  F  is  absolutely  continuous  on  [0,  T)  with  p.d.f.  f,  then 


(2.5) 


This  motivates  the  following. 

Definition  2.2. 

If  the  times  to  failure  of  the  items  are  independent  and  identically 
distributed  (iid)  with  c.d.f.  F,  F( 0)  ■  0,  and  F  is  absolutely  continuous  on 
[0,  T)  with  p.d.f.  f,  then  the  likelihood  function  L  for  Testing  Plan  A  is 


n  l , 

r«l  r 


(2.6) 


where 


Lr  5  Lr(Xir’,,*‘XK  -l,r) 


is  the  random  variable, 

Kr-1  K  -1 

L  «  [l-F({T  -  r][  x  D)  rn  f (X,  ) .  (2.7) 

r  i«l  ir  J«1  Jr 

Equation  (2.6)  is  a  result  of  the  independence  of  the  n  experiments  and 
Equation  (2.7)  is  obtained  from  the  integrand  of  Equation  (2.5)  when  the 
random  variables  replace  their  corresponding  sample  points.  Definition  2.2 
will  be  used  in  Section  3  and  4  to  derive  the  MLE's  for  the  parametric  classes 
of  distributions.  A  generalized  definition  of  MLE,  based  on  Equation  (2.4), 
will  be  defined  in  Section  5  for  the  nonparametric  class. 
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3.  SINGLE  PARAMETER  ESTIMATION 


3.1  Introduction. 

Throughout  this  section  it  will  he  assumed  that  the  underlying  c.d.f. 
of  the  times  to  failure  is 

F(x)  «  1  -  exp(-Xg(x))  (3.1) 

for  0  <  x  <  T,  X  >  0,  g{*)  is  known  and  strictly  increasing  with  g(0)  =  0 

A 

and  derivative  g'(x)  0  <  x  <  T.  We  shall  derive  the  MLE  X  of  X  and  show 

A  A  ft 

that:  (a)  X  is  strongly  consistent,  as  n  (h)  X  is  asymptotically 

n  a  n 

normally  distributed  as  n  (c)  Xfl  is  asymptotically  efficient,  as  n  — >  «. 

Also,  a  major  drawback  to  some  previously  published  work  dealing  with  the 
estimation  of  X  shall  be  discussed. 

3.2  Previous  Work. 

Gnedenko,  Belyayev  and  Solovyev  (1969),  devoted  an  entire  section  of 
their  book,  beginning  on  page  168,  to  the  MLE  of  the  parameter  X  when  the 
underlying  distribution  is  the  exponential  law 

G(x)  -  1  -  exp(-Xx)  (3.2) 

x  >  0,  X  >  0,  for  six  life  testing  plans,  one  of  which  was  Testing  Plan  A. 
Observe,  now,  that  if  X  is  a  random  variable  with  c.d.f.  given  by  (3.1) 
for  x  >  0  then  g(X)  is  a  random  variable  with  c.d.f.  given  by  (3.2).  Noting 
this,  Gnedenko,  et  al  mentioned  that  if  the  life-time  distribution  is  given  by 
(3.1)  for  x  >  0  then  one  may  make  the  transformation  Y  *  g(X)  on  the  data  and 
UBe  their  exponential  procedures  to  estimate  X.  However,  it  was  not  pointed 
out  that  if  the  exponential  procedures  are  used  for  Testing  Plan  A  then  the 
total  testing  time  will  not  necessarily  be  T,  which  violates  the  purpose  of 
this  testing  plan. 

To  see  this  difficulty,  observe  that  the  suggested  test  plan  implies  that 
one  make  the  transformation 


«ir  -  8<*lr> 


ik 


i  >_  1,  r*l,  . ..,  n,  choose  a  constant  C  >  0,  and  continue  testing  in  the  r-th 
experiment  (r=l,  . ..,  n)  until  time  C  on  the  g(*)  time  axis.  If  one  does  this 
then  the  random  number  of  items,  Kr,  put  on  test  in  the  r-th  experiment  is  the 
first  integer  such  that 


Wiri° 


r«l,  n.  Therefore,  the  actual  (untransformed)  total  testing  time  in 
the  r-th  experiment  is 


Kr“l 

E 

i*i 


Xir  + 


-1 


r=l,  n.  If  C  is  to  be  chosen  such  that  the  total  testing  time  is  T, 
then  for  Kr  =  1,  the  total  testing  tir«  is  g_1(C)  ■  T.  Thus,  g(T)  is  the 
only  candidate  for  C.  Now,  if 

V1  ,  /  V1  X 

E  Xir  +  8  (  -  E  8(Xir)  )  »  T 

i=l  '  i-1  / 


for  Kr  >  1,  this  would  imply  that 


which  is,  in  general,  not  true  for  non-linear  g.  Thus,  when  one  makes  such 
a  transformation  the  total  testing  times  for  the  n  experiments  will  generally 
be  random  variables.  This  violates  the  purpose  of  Testing  Plan  A  which  is  to 
fix  the  total  testing  time  at  T.  The  work  presented  in  this  section  allows 
one  to  estimate  X  without  using  such  a  transformation  and,  hence,  avoiding 
this  difficulty. 
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3.3  The  MLE  of  X. 

A 

The  MLE  Xn,  say,  of  X  shall  now  be  derived.  In  what  follows  let 


g(T)  »  lim  g(T-e),  t  >  0. 
e-K) 


Lemma  3.1 


The  MLE  X  of  X  is 
n 


K 


n  rSl  r«l  iBl  ir 


). 


(3.3) 


Proof: 


By  Definition  2.2  the  likelihood  function  is 

n 

L  «  II  L 
r-1  r 


where 


V1 


K  ■  exp(-xg(YK.  J)  n  Xg'(Yir)exp(-Xg(Y<  J), 


Ir  .  , 
r  i=l 


ir' 


r*l,...,n.  Maximizing  L  with  respect  to  X  yields  XR  given  by  (3.3). 
The  reader  should  note  that  if  F  is  continuous  at  T,  then 


E(K-D 


r«l 


is  the  number  of  failures  in  the  n  experiments.  Also,  if  the  times  to  failure 
are  exponentially  distributed  (i.e.,  g(x)  ■  x,  x  >  o),  then 


16 


A 

Hence,  X  is  the  usual  estimator  in  the  exponential  case, 
n 

Observe,  now,  that  identity  (2.U)  implies  that  the  probability  of  any 
event  associated  with  the  outcome  of  an  experiment  based  on  Testing  Plan  A 
only  depends  on  F(x)  for  0  <  x  <  T.  Since  these  probabilities  do  not  depend 
on  F(x)  for  T  <_  x  <  *,  it  follows  that  the  statistical  properties  of  any 
random  variable  obtained  from  Testing  Plan  A  are  independent  of  F(x)  for 
T  <_ x  <  •».  We,  therefore,  have 

Theorem  3.2 

The  statistical  properties  of  Xfi  and  all  other  randan  variables  obtained 
from  Testing  Plan  A  do  not  depend  on  the  values  of  F  on  [T,  •»). 

A 

3.U  Strong  Consistency  of  XR. 

A 

Wa  will  now  show  that  Xr  converges  to  X  almost  surely*(a.s.)  as  n 
To  show  this  we  will  need  the  following  results. 

Lemma  3.3 

If  F1  is  any  c.d.f.  such  that  F(x)  »  F^x),  0  <_  x  <  T,  then 
PC^  *  k|F]  *  P^  <*  k | F^ ] ,  for  all  k  *  1,  2,  ... 

Proof: 

The  proof  follows  from  Theorem  3.2. 


*The  term  "almost  surely"  means  that  a  certain  event  holds  with  probability 
one. 
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The  following  result  is  needed  to  show  consistency  and  is,  also, 
useful  throughout  the  remainder  of  this  section. 

Theorem  3.1* 

j  EdCj-l)  -  E(|j  g(Yn)).  (3.J») 

Proof: 

Let  *  Xi;L,  i  =  1,2,...,  K  ■  1^.  By  Lemma  3.3  E(K)  does  not  depend 
on  F(x)  for  x>T.  Hence,  if  g(T)  <  »  then  we  may  extend  g(x)  for  x  >  T 
in  any  manner  we  wish  to  keep  F  a  e.d.f.  and  E(K)  will  remain  unchanged. 

We  therefore  assume  that  g(x)  =  g(T)  +  (x-T)  for  x  >.  T,  when  g(T)  <  ». 
Hence,  whether  or  not  F(T)  <  1  or  F(T)  =  1,  g(X^)  has  an  exponential 
distribution  with  mean  1/X.  By  Wald's  Lemma  (19W») 


t-  E(K)  «  E(£g(X.)). 
*  i»l  1 


(3-5) 


Now, 


K-l 


E(g(XK))  -  E(E(g(XR)|^  Xi)) 


K-l 


E(E(g(X)  |X  >  T  -  £  X  )) 

i _ ^  • 


i*l 


-  E(E(g(X)|g(X)  >  g(T  -  £  X.))) 

i*l  1 

where  g(X)  is  a  random  variable  with  e.d.f.  l-exp(-Xy),  y  >  0.  Thus, 
E(g(XK))  =  E(j  +  g(T  -  £  XA)) 


i»l 


r-  +  E(g(T  -  ff  XJ)- 
i*l  1 


(3.6) 


Equations  (3*5)  and  (3.6)  imply  (3.^). 


;  fSS' 
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r 


Proof: 


K 


n  M 


n  V 


Let  M  *  £  g(Y  ),  V  =  (K  -l),  M(n)  =  £  V(n)  =  £ 
r  Jml  jr  r  r  yxl  n  r«l 

and  let  Z  be  the  tvo  dimensional  random  vector,  Z  =  (M  ,  V_),  r  =  l,...,n. 
~r  ~r  r  r 

Also,  let  H(a,b)  be  the  function  of  the  two  variables  a,  b,  H(a,b)  *  a/b. 
Now,  (M(n),  V(n))  is  the  first  moment  vector  corresponding  to  the  sample 
'1,-2**  *  *  *~n*  ^  Cramgr  pages  353*  36?)»  H(V(n),  M(nj)  =  XR  is 

asymptotically  normal  with  asymptotic  mean  =  *  by  Equation  (3.M » 

ElMln;) 

and  asymptotic  variance 


^r(V(n)J,  _  2  Cov(V(n)>  M(n))  EXU^D-  +  Var(M(n) )  . 

E2(M(n) )  E3(M(n))  B4(M(n)) 


Using  Equation  (3-M  again  the  asymptotic  variance  equals 


1  r  Ki 

- - jVarOCj-l)  -  2X0^0^-!,  £  gtt^)) 


«<yj1)) 


j-i 


h  1 

*  -'2  v*r<j4  “V1]  • 


This  completes  the  proof. 

The  next  theorem  will  be  useful  in  what  follows. 
Theorem  3.7 


K, 


E(K.-1)  *  Var(JC.-l-X  £  g(Y,. 
1  1  j-1 


)) 


(3.8) 


Proof: 


Let  K  «  K  ,  XA  =  XjLl,  i  »  1,...,  K-l,  and  Y.  »  Y^,  i  *  1,...,K. 
Also,  let  f(x)  -  Xg'(x)exp(-Xg(x)),  and 

k-l  _  k-l 

p(x. » • • •  »x,  .  |X)  ■  (l-P((T-  l  X,D  n  f(x, ) . 

1  K"  1=1  1  J=1  J 

It  is  easy  to  verify  that 
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▼ 


E{|^  log  p{X1,...,XK_1|X))2  =  -E(~  log  p(X1,...,XK_1|x))  .  (3.9) 

dX 

The  left-hand  side  of  (3.9)  is  equal  to 

E(~-  £  s(Yj))2. 

J*1  J 


But  using  Equation  (3.U)  we  have 


Var(^-  £  g(Y . ) )  «  E(^-  £  g(Y.))2. 


J-l 


J*1  J 


(3.10) 


The  right-hand  side  of  (3. 9)  is  equal  to  E(K-l)/X  .  Hence,  (3.8)  follows. 


Using  Equations  (3.U)  and  (3.8)  it  follows,  also,  that 


(3.11) 


D  =  XVEO^-I). 

Prom  this  we  have 
Corollary  3.8 

The  asymptotic  distribution  of  (X^-X  y/x^nEflCj-l))  is  Normal  (0,1) 
as  n  •>  "». 

By  the  strong  law  of  large  numbers  Corollary  3.8  gives 
Corollary  3.9 


The  isymptotic  distribution  of  (X  -X)//X  /(£  (K  -l)  is  Normal  (0,1) 

n  r«l  r 

u  n  +  «, 

.  3.6  Asymptotic  Efficiency  of  X  . 

n 

Let  h(X1». . . .X^)  be  an  estimate  of  X,  where  Xj^  *  X^  ,  i  *  1,...,  K-l, 
K  a  K^.  Then 


Theorem  3.10 


D(1  +  ^B(X))2  iVar(h(X1,...,XK_1)), 
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where  B(X)  *  E(h(X1». . . .X^) |> )  -A,  and  D  is  given  by  Equation  (3.7). 
Proof: 

It  is  straightforward  to  show  that 

[1  +  ^B(A)]2  <_  Var(h(X1,...,XK_1)|A)  E(|^  log  p(X1,...,XK_1|x))2. 

(Note  that  in  the  sequential  form  of  the  Cram$r-Rao  bound  that 
k 

J1  f(x. )  corresponds  to  p(x,...,x.  ,|X).)  Using  Equations  (3.8),  (3.10), 
i«l  1 

and  (3.11)  yields  the  result. 

This  implies  that  if  h^  is  an  unbiased  estimator  of  X  based  on  the 
outcome  of  n  experiments,  then 

£<Var(h.).  (3.12) 

n  —  1 

From  this  we  have  the  following 
Theorem  3.11 

A 

Xr  is  an  asymptotically  efficient  estimator  of  X. 

Proof: 

Cur  concept  of  efficiency  is  the  same  as  the  concept  given  by  BAN 
estimators  for  fixed  sample  size.  (See  Rao  (1968),  p.  284.)  The  result 
then  follows  from  Theorem  3.6  and  inequality  (3.12). 

3.7  Comments . 

Note  that  if  the  times  to  failure  of  the  items  put  on  test  actually 
have  the  c.d.f.  F(x)  =  1  -exp(-Ag(x) )  for  0<x<T  +  b,  0<b<_®,  then, 
of  course,  the  assumptions  required  for  F(»)  are  satisfied.  In  this  case 
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'HI  ^ 


the  estimate  Xfi  allows  one  to  estimate  F(x)  for  0  <  x  <  T  +  b  from  data 
restricted  to  [0,T].  Suppose,  however,  that  the  c.d.f.  has  the  form 
F(x)  *  1  -exp(-Xg(x) ) ,  0<a<_x<T  +  a.  Then  items  of  age  a  have  the. 
c.d.f.  G(x)  =  1  -exp(-Xq(x))  a  <_  x  <  T  +  a,  where  q(x)  »  g(x)  -  g(a). 
Thus,  one  may  put  items  of  age  a  on  test  at  time  0  and  use  the  theory 
presented  in  this  section  to  estimate  F(x)  for  a  <_  x  <  T  +  a. 

It  is  to  be  remarked,  also,  that  numerous  computer  simulation  runs 
substantiate  the  conjecture  that  the  MLE  of  X  is  generally  not  unbiased; 
i.e.,  in  general  E( X^)  j  X.  However,  the  bias  approaches 
gets  large. 


zero  as  n  or  T 


U.  MULTIPLE  PARAMETER  ESTIMATION 


l*.l  Introduction. 

In  this  section  it  is  assumed  that  the  c.d.f.  F  governing  the 

times  to  failure  of  the  items  put  on  test  is  absolutely  continuous 

on  (0,T)  with  p.d.f .  f  and  F(0)  »  0.  Also,  it  is  assumed  that  the 

failure  rate  f(x)/[l-F(x)]  *  X  ,  for  xe[S  ,S  ., ),  q  *  0,1,...,  t-1, 

q  q  q+1 

where  0  *  S..  <  S.  <  ...  <  S,  =  T,  and  0  <  X*  <  X  <  ...  <  X  ,  <  ». 

Thus,  assuming  that  the  S^,  q  =  0,1,..., t  are  known,  and  data  are 
collected  from  Testing  Plan  A,  the  MLE's  of  Xq>  q  =  0,1,...,  t-1, 
are  determined  and  shown  to  be  strongly  consistent  estimators 
as  n  +«,  The  asymptotic  normality  of  these  estimators,  as  n 
is,  also,  established. 

Consider  now  a  situation  when  Testing  Plan  A  and  this  class  of 
distributions  may  be  applicable.  The  guidance  system  or  some  other 
system  or  component  in  a  rocket  may  have  a  failure  rate  which  is 
constant  when  the  booster  of  the  first  stage  of  the  rocket  is  in 
operation.  However,  when  the  first  stage  falls  away  and  the  second 
stage  booster  is  fired  the  failure  rate  of  the  system  may  change  and 
in  fact  increase  instantly  to  a  constant  value  during  this  stage.  If 
this  is  true  for  all  stages  of  the  rocket,  then,  (since  the  exact  length 
of  each  stage  and  the  exact  time  of  the  staging  is  known),  laboratory 


2k 


testing  may  be  used  to  estimate  the  failure  rate  of  the  system  for  f 

J 

the  duration  of  its  mission.  $ 

} 

Another  possible  application  may  arise  when  one  is  interested  j 

in  estimating  the  failure  rate  of  an  electronic  apparatus  as  a  \ 

function  of  the  amount  of  voltage.  It  is  not  unusual  for  electronic  j 

tubes  and  the  like  to  have  a  constant  failure  rate  when  the  voltage  J 

is  constant.  If  the  failure  rate  is  a  nondecreasing  function  of  the 
voltage  thrn  one  may  estimate  the  failure  rate  for  specific  values 
of  the  voltage  in  the  following  way.  Let  the  testing  time  T  be 
fixed  and  let  v^  <  V1  <  ...  <  v^  he  voltages  which  are  of  interest 
to  the  experimenter.  Let  X^,  i  *  0,...,  t-1  be  the  failure  rate  ■ 

of  the  items  when  they  are  receiving  voltage  v^  Also,  let 
[S^,  i  ®  0,...,  t-1  be  a  partition  of  [0,T).  When  an  item 

is  put  on  test  it  receives  voltage  v^.  If  it  operates  without 
failure  for  time  then  the  voltage  is  increased  instantly  to 
v^  Similarly,  if  the  item  operates  for  time  i  <  t,  then  the 
voltage  is  increased  to  v When  an  item  fails  it  is  replaced 
instantly  by  another  new  item  and  the  voltage  is  reduced  to  v^.  If 
this  item  operates  for  time  S.^  without  failure  then  the  voltage 
is  increased  to  v^,  and  so  on.  This  process  is  continued  until 

i 

tine  T.  The  theory  presented  in  this  section  will  allow  one  to  j 

estimate  the  A.,  i  *  0,,,,,  t-1,  * 

i  * 

Applications  of  this  model  may  also  be  possible  in  the  < 

fields  of  drug  testing  and  toxicology.  For  example,  suppose  one 

\ 

> 


4 

h 

$ 

V* 
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is  interested  in  the  effect  of  a  toxic  agent  such  as  DDT  or 
the  effect  of  radiation,  which  decompose  at  a  very  slow  rate. 
The  failure  rate  depends  on  the  dosage  level  and  may 
be  taken  as  constant  for  reasonably  short  periods  of  time  and 
nondecreasing  as  the  dosage  level  increases.  The  dosage  is 
sequentially  increased  at  the  end  of  these  successive  periods 
and  the  model  presented  in  this  section  may  be  used  to  estimate 
the  failure  rates  corresponding  to  the  different  dosage  levels 
for  the  time  period  of  Interest. 

h.2  The  Naive  MLE  of  the  X  . 

_ 1 

We  begin  this  section  by  finding  the  values  of 

1  =  °»»*»,  t-1,  which  will  maximize  L,  given  by 

Definition  2.2,  without  the  restriction  that  X^  <,  X^  <_  . . .  <_  X^ 

From  Definition  2.2  the  likelihood  L  for  the  r-th 

r 

experiment  is 

Kr-i  Ky-1 

Lr  =  [l-F( (T  -  p  XirD]  H  f(Xir),  r  =  1,...,  n, 

and, 

tne  lixelinood  L  for  the  n  independent  experiments  is 

i  n 

l  »  n  L  . 

r*l  r 

Let  I(*|R)  be  the  indicator  function  of  R.  Furthermore, 
define  the  function  by 
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- — pm" 


V*l—- V  ■  J2  l(zi,tSq*8q+l)) 

and  0  otherwise,  and  define  the  function  Aq(z^,... ,8^)  by 
Aq(rl****  »zp>  *  J^q+^V  I^zi^Sq+l*T^ 

♦  (Vsq)  Kti|[sq,s<i+1))}. 

Kr-1 

**  Yir  "  Xir*  r  "  1  *  1 . V1*  “>d  \,r  *  M  Xir’ 

r  •  1... .  ,n.  Denote  by  Grq,q*0,.. .  ,t-l,  the  function  0  (Y '  . .  ,Y 

which  is  the  number  of  failures  in  the  r-th  experiment  which  lie 

in  [Sq,  Sq+1).  Also  denote  by  Ayq,  q  ■  0,...,  t-1,  the  function 

A  (Y.  , . . .  ,Y.,  ),  which  is  the  total  time  on  test  for  the  r-th 

q  *r  Kf,r 

experiment  over  tSq,  Sq+1). 

Observe,  too,  that  if  r(x)  ■  f(x)/(l-F(x)) ,  xe[0,T)),  then 

F(x)  =  1-exp {-  /  r(y)dy }  and  f(x)  =  r(x)  exp{- J  r(y)dy}  for  xe[0,T). 
*0  0 

The  next  lemma  will  allow  us  to  easily  find  the  values 

A 

of  the  Xq,  q  *  0,,..,  t-1,  say  XRq,  q  ■  0,...,  t-1,  which 

maximize  L  «  1  L  ,  without  the  restriction  that 
r»l 

»n0  1  Vi-  i  >»(,.!)•  clU  the  'Wve”  “*  °f  V 

(The  term  "unrestricted"  MLE  is  also  used  in  the  literature.) 
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feg&JuL- 

the  likelihood  Lr  for  the  r-th  experiment  nay  be 
written  as 


lr  ■  ]i  *°'J  r  *  1 . ’• 


ftroof : 


First  note  that 
t-1 

r(x)  *  Aj  I(x|{Sj,Sj+1)), 
for  xc(OfT).  Thus,  Lf  nay  be  written  as 

V1  t  1 

*V  ■  *x  <1  xj 


*  <W 


Row  observe  that 


t-1  G  .  V1  t-1 


H  \ri  m  n  (  l  A.I(Y.(s^1+1))). 
J«0  3  i»l  J*0  3  xr  J  3  x 


Equation  (4.1)  follows. 

* 

The  following  corollary  gives  the  naive  MLE  A  of  X^, 

q  *  0|. * • f  t— 1. 


(4.1) 
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Corollary  h. 2 


The  maximum  of  L  =  n  L  is  obtained  if  X  *  X  , 

,  r  q  nq 

r*l 


q  ■  0,...,  t-1,  where 


;  .Sjl 

nq  n 

Z  *r= 


lf  Z  V  *  °. 


X  -  0 

nq 


lf  Z  Aro  '  »• 


Proof: 


•• 

If  53  A  ^  0«  the  result  follows  directly  from  (*»•!). 


14  4* 

Also,  £  A  *  0  implies  that  V  Gra  *  G* 

r«i  " 


Since  X  >  0  we 

q  - 


0  -  ” 

define  0  to  equal  1  and  thus  take  X  «  0  if  V  A  *  0. 

no  — — _  ra 


3i  r1 


This  will  maximize  L. 


1*.3  Strong  Consistency  of  X  . 


The  next  theorem  will  be  used  to  show  strong  consistency  of 

A 

X  ,  q  =  0,...,  t-1,  given  in  Corollary  k.2. 
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Theorem  !+.3 


Let  H  be  a  c.d.f.  sucn  that  H(0)  =  0,  and  for  u  and  v  where  • 

0  <  u  <  v,  H(v“)  -  H(u“)  >  0.  Let  X^,  Xg,.,.,  be  i.i.d.  random  variables 
with  c.d.f.  H,  and  let  K  be  the  stopping  variable  defined  as  the 
first  integer  such  that 

K 

£  X  I  T. 
i-1 

In  addition  suppose  that  H  is  absolutely  continuous  on  [u,  v)  with 
p.d.f.  h  and 


xe[u,  v).  Then 


h(x)/[l-H(x)J  =  X, 


/  K-l  \ 

(£  ittjtu,  v))j 


{(v-u)  I(Y1 | [v,  -))  +  (Yi~u)  l(Yi|[u,  v))}^ 


X  • 


(U.2) 


Proof 

See  Crow  and  Shimi  (1971 ) • 


Theorem  U.l* 

A 

The  naive  MLE  Xfl^  is  a  strongly  consistent  estimator  of 
X^,  <1  -  t-1,  as  n  +  ®, 


Proof; 

If  Xq  =  0,  then  F(Sq+1) 


n 

0  and,  hence,  Y*  G  =0  a.s.  Thus, 
r=l  r(J 
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X  =  0  a.s..  If  X  >0,  then 
nq  q 


^  -  fer  ■ 


X  si  «  s  •  sis  n  +  # 

q  ’ 


by  the  strong  law  of  large  numbers  and  (4.2). 


U . U  The  MLE  of  the  X  . 


In  the  next  theorem  we  will  find  the  values  of  the  X  , 

q  =  0,...,  t-1,  say  X^,  which  will  maximize  L  under  the 

restriction  that  X^Q  <_  Xr1  It  will,  also,  be 

shown  that  X  is  a  strongly  consistent  estimator  of  X  . 

nq  q 


Theorem  4.J 


The  MLE  X  of  X  ,  q  =  0,...,  t-1,  which  maximizes 
nq  q’  n 


L  =  n  L  under  the  restriction  that  X  n  <  X  ,  <  . . .  <  X  * 
r_^  r  no  —  nl  —  —  n(t-ij 

is  given  by 


X  =  min  max 
nq 

v>q  u<q 


E  E»rt 

r°l  d«u _ 

n  v 

E  E*ra 

r=l  d*u 


(4.3) 


Proof: 


From  Lemma  (4.1) 


£°rJ 

t-1  r=l  rj 

L  =  II  X  exp 

J-0  J 


('XJ  r4  ^j)  ' 
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i 


Applying  the  results  of  Brunk  (1958)  yields  (U.3). 

Remark  U.6 

Brunk  (1958),  page  UVf,  explains  a  method  for  determining 

*>  A 

X  .  Let  X  be  the  naive  MLE  of  X  given  in  Corollary  h.2.  If 
nq  nq  q 

A  A  A  «  A 

X.  <X  ,  <  hi  <X  i.  then  X  *  X  .  If  for  some  i, 
nO  —  nl  —  —  n(t-l)’  nq  nq 

A  A  A  A 

Xni  >  Xn(i+l)’  then  replace  Xni  “d  Xn(i+l)  by 

n  n 

^  (°ri  +  3r(i+l)V^  (Ari  +  A  r(i+l))^ 

If  a  reversal  still  exists,  replace  by  appropriate  averages. 

That  is,  if 


[L  (Gri  +  0r(i+1))]/[E  (Ari  +  Ar(i+i)^  ]  >Xn(i+2)’ 
r*l  r»l 

then  replace  In(1+1).  and  »a(148).  by 

n  n 

[  E  (Gri  +  Gr(l+1)  +  Gr(i+g))]/[  £  (Ayi  +  Ar(i+1)  +  Ar(i+2)]. 
r-i  r»i 

Continue  averaging  whenever  there  is  a  reversal.  This  will 

yield  a  monotone  increasing  sequence,  XnQ  <_  Xnl  <_  X^  <,...£  Xn(t— l) * 

which  are  the  MLE's  of  the  X^'s  subject  to  Xq  <_  X^  <_...£  Xt 

We  now  have 
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Theorem  4.7 


The  estimates  xnq  of  xq»  <1  a  0 . t-l,  given  in  Theorem 

3.5  are  strongly  consistent  as  n 
Proof: 

This  is  immediate  from  Remark  4.6  and  the  fact  that 

* 

the  X  's  are  strongly  consistent  estimators, 
nq 


4.4  Asymptotic  Normality  of  the  Estirators. 

Without  any  loss  of  generality  denote  by  x^,  i  *  l,2,...,m, 
the  set  of  all  X^ ,  i  *  0,1,...,  t-l  such  that  X^  j  0.  In  the  fol- 

A  A 

lowing  the  asymptotic  normality  of  the  vector  (X  X  ), 

nj.  nm 

suitably  normalized,  is  established.  The  normalizing  sequence 
ib  determined  from  the  experimental  outcomes  and  X^,  i  «  l,...,m. 
Furthermore,  it  is  shown  that  the  dispersion  matrix  of  the 
limiting  distribution  is  the  m*m  identity  matrix  I. 

Let 

n 

TnJ  »  E  "  EU^n/n,  J  *  1,2 . .  (4.4) 


and 


n 

Unj  *  E  ( A± j  -  EU^JJ/n,  J  =  1,2,..., m. 


(4.5) 


Define 


nj 


nj 


U 


n( j-m) 


j  *  1,2 . m 

J  «  n  ♦  1,. . . ,2m 


(4.6) 
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and  E  =  (o^)  is  a  2m  x  2m  matrix,  where 

o^j  =  Cov(Y^,  Y^j ) ,  i,  J  *  1,2,. . . ,2m. 

By  the  multivariate  central  limit  theorem,  it  follows  that 

«£  (Ynl.  Yn2’---*Yn,2m)  isAN  (^,E)* 

We  shall  use  the  following  theorem  given  in  Rao  (1968, 
page  322),  and  we  state  it  here  for  easy  reference.  "Let  Tr 
he  a  k-dimensional  statistic  (T^q,.  . .  ,1^)  with  the  asymptotic 
distribution  of  \/n  ((T^-8^) * •  •  • »  (T^n-0^  ^eing  k-variate 
normal  with  mean  zero  and  dispersion  matrix  E  *  (a^).  ^ 

f !,..., f^  be  q  functions  of  k  variables  and  each  f^  be  totally 
differentiable.  Then  the  asymptotic  distribution  of 
&  ^(t^n,. . .  »Tkn)  ”  i  *  1»2». . .  ,q,  is 

q-variate  normal  with  mean  zero  and  dispersion  matrix  r  I  T', 
where  T  ®  (3^/30^)." 

Let  fj(y^,yg,. . .  ^e  real-valued  function  of  2m 

variables  defined  by 

Yi(y1.--.,y2m)  c  y±  -  ^y^*  1  *  1,2,. ..,m.  (M) 

Then 

1  if  j  -  i 

3V3yj  *  "Xi  if  J  "  1  +  »  (b.8) 

0  otherwise 


3h 


Therefore,  one  can  show  that  r  I  P'  =  (t^j),  w^ere 

Tij  =  Var(Gii-XiAii),  if  1  =  J. 

and 


=  Cov(0u,01J)  -  Xt  CovlAjj.Gy)  -  Xj  CovfG^,^) 
+  XiXj  Cov(Ali,A1j),  if  i  *  j. 


Hence,  by  the  theorem  mentioned  above, 

A 

is  AN  (0,  T  E  r). 

Let  A^  =  E(A^),  i  =  l,2,...,m.  Note  that  X i  #  0  implies 
Ai  ^  0.  One  can  see  then  that  the  asymptotic  distribution  of 


D 

r=l 


G  A  , 
rl  1  rl 


G  -X  A 
rmmrm 


r*l 


) 


x 

-n 


r—  /  ^  “ X-A  ,  Jl*  G  ,  A  \ 

\r-l  "*1  £i  ”*»  / 

is  NfO.E^,  where  Ex  =  ^ Tij/AiAj ^ * 

1  n 

Since  —  £  A  .  •>  A.  a.s.,  one  can,  also,  show  that 
n  ri  i 
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is  AN  (0,I1).  But  since 

** =  SW^ri-  1 '  l«8 . . 

it  follows  that  Sri  *  *  *  *lnm“ln)  *s  ^ 

Let  Di  ■  Tij/Ai»  L  ~  1»2,. . .,m.  Then 


is  AN  (0,E  ),  where 


A  A 

r-  /Xnl~Xl  Xnm~Xm\ 

✓n  1  —  )««m  _  / 

V  /ft  sr  / 

in 


1/2. 


^ s  <  V s  VVjV  >• 


Note  that  6^  =  1  if  i  =  J,  and 


^  Var(G^-XjA^) ,  i  -  l,2,.#.,m. 


Observe ,  also,  that  E(G^)  =  XjE(A^),  i*l»2,...,m. 
Now,  assuming  that  X^  ^  0  and  Xg  t  0,  this  implies 


(U.9) 

(**.10) 

by  Equation  (U.2). 

k-1 

-X.A.)  n  dx, • 

J  J  i=l 
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Thus,  if  i  =  a, 

0  =  -i-  E(G11)2  -  -§-  E(Gui  -  -f- ElOy-A^)  ♦  Muf 
Xi  Xi  *i 

Using  (U.2)  again  gives 

E(Gli)  =  Var(Gli)  +  X*  VartA^)  -  2X±  Cov(G li»A]Li) 


If  i  i  s,  then 


t-1 

n 

J*0 


k-1 

exp(-X,A.)  n  dx, , 
J  J  i«l  1 


and  this  gives 


0  =  E(GliGls)  "  XsE(GliAls)  *  XiE(AliGls} 


+  ^i^s*(AliAl8)  • 


Hence , 

X8E(Gli)E(Al8)  +  XiE(Ali)E(GlS)  ’  E(Gli)E(GlS) 

-  XiXsE(Ali)E(Als)  -  Cov(Gu,Gls)  -  X0  CovCG^.A^) 

-  XA  Cov{Ali,Gls)  +  XiXs  Cov(Ali,Als)  . 


(4.11) 


(4.12) 
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Since  E(G1(i)  =  A^E(Alti),  it  follows  that  the  left-hand 
side  of  (U.12)  is  equal  to  zero  and,  hence,  =  I.  Thus, 


(\  ,  “\ .  A  “  A  V 

nl  1  nm  m\ 

Jd7  ) 


A  -A  , 
nm  m  ’ 


JT 

m 


is  AN  (0,1).  Note  that  if  A.  <  ...  A  then  A  . 
— ’  1  m  ni 

for  n  2  n0»  say*  Thus» 


Ai  a.s. 


(A  ,-A,  A  -A  \ 

nl  1  nm  m  \ 

_  )•«•»  I 

/d:  ' 

1  m 

is  AN  (0,1).  By  (U .11) 


E(G,J 


Di  =  -f-  Tar'<5li-X1Ali  >  -  ,s 


Using  (1*.2),  this  gives 


D.  = 


i  "  E(Cn)  • 


1  T**  i 

Note  that  since  —  >  G  .  ■*  E(G, .)  a.s.,  then - 

n  ri  li  ,  n 


1  t.G 

n  : 


-*•  a.s. 


r»l 


ri 


The  next  result  is  immediate. 


Theorem  k.8 

The  asymptotic  distribution  of 


»  •  •  •  »  ( ^  “ A—)/ 
nm  m 


■L2Z1 

V  £•-  J 


is  N(0,I) 


as  n  -*  ® . 
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As  before,  if  X1  <  ...  <  XQ,  then  the  same  result  holds 

A  M 

if  the  Xni  are  replaced  by  X^, 

Remark  U.9 

If  one  assumes  that  Xq  >_  X^  >_  ...  >_  X^  ^  then  the  likelihood 

n  * 

L  «  II  L  is  the  same  and  hence  the  naive  MLE  X  of  X  is  the 

ral  r  nq  q 

same  and  is  consistent.  The  MLE  A  may  be  easily  found  by 
applying  again  the  results  of  Brunk  (1958).  Of  course  A  is 
also  consistent  in  this  case. 

The  reader  is  probably  aware,  at  thiB  point,  that  if  t»l  then 
this  class  of  distribution  reduces  to  the  class  considered  in  the 
last  section  when  g(x)  *  x.  The  MLE  is  equivalent  in  both  situations. 
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5.  NONPARAMETRIC  ESTIMATION 
5.1  Introduction. 

The  concept  of  "failure  rate”  is  a  very  important  practical  concept 
in  reliability  and  has  motivated  several  very  useful  classes  of  distri¬ 
butions,  e.g.,  Increasing  Failure  Rate  (IFR)  class,  Decreasing  Failure 
Rate  (DFR)  class,  U-Shaped  Failure  Rate  class.  The  failure  rate  r( • ) 
of  a  distribution  function  F  having  derivative  f  is  defined  by 

r(x)  =  f(x)/[l  -  F(x)]  for  F(x)  <  1 


and 


r(x)  ®  »  for  F(x)  **  1. 


The  estimation  problem  that  ve  shall  be  concerned  with  in  this 
section  can  be  summarised  in  the  following  way.  The  life-time 
distribution  of  the  items  to  be  tested  is  assumed  to  have  an  increasing 
failure  rate  over  the  interval  [0,T),  i.e.,  IFR  on  [0,T).  No  other 
assumptions  about  the  distribution  or  its  failure  rate  iB  given  outside 
that  interval.  The  assumption  of  increasing  failure  rate  can  be 
changed  to  decreasing  failure  rate  and  the  same  results  will  follow 
with  the  obvious  modifications.  Data  are  assumed  to  arise  from  Testing 
Plan  A. 

Let  [ oF, Bp 3  be  the  support  of  the  c.d.f.  F.  The  notion  of  IFR 
on  [0,T)  is  made  more  precise  by  the  following  definition. 


Definition  5.1 

Let  T  be  a  fixed  positive  real  number.  A  c.d.f.  P,  F(0)  *  0,  is 
said  to  be  IFR  (increasing  Failure  Rate)  on  [Q,T)  iff  it  satisfies  one 
of  the  following  conditions:  (i)  -log[l-F(x)]  is  convex  on 
[ap,  Bp],  0  <  °F  I  Bp  1  T  and  =  1  if  &F  <  Ti  or  (ii)  the  part 

of  the  support  of  P  in  [0,T]  is  empty. 

Let  F  *  (F:  F  is  IFR  on  (0,T)}. 

The  following  theorem  is  similar  to  a  theorem  concerning  IFR  distri¬ 
bution  given  by  Marshall  and  Proschan  (19^5),  and  we  shall  omit  its 
proof  because  of  this  similarity. 

Theorem  5.2 

Suppose  F  e  F,  0  <  Z  <  Bp.  Then  F  is  absolutely  continuous  on  [0,Z). 
Note  that  F  may  take  a  Jump  at  Bp  if  Bp  <  T. 

Using  the  definition  of  failure  rate  and  the  above  theorem  one  can 
very  easily  prove  the  following. 

Theorem  5-3 

(i)  F  e  F  iff  r(*)  is  nondecreasing  on  (0,Bp),  0  JL  “p  1  Bp  ^T, 
and  F(Bp)  ■  1  if  Bp  <  T. 

(ii)  The  part  of  the  support  of  F  in  [0,T]  is  empty  iff  r(x)  =  0 
on  [0,T]. 

(iii)  If  F  e  F,  then  for  xe[0,  Bp) 

F(x)  =  1  -  exp(-R(x)),  and 

f (x)  =  r(x)  exp(-R(x) ) ,  where 

x 

R(x)  =  /  r(y)dy, 

0 


The  class  F  includes  the  usual  class  of  IFR  distributions.  It  is 
easy  to  show  that  there  exists  no  sigma-finite  measure  relative  to 
which  all  the  distributions  in  F  are  absolutely  continuous. 

Since  we  are  dealing  with  a  nonparaoetric  family  of  distributions 
for  which  there  exists  no  sigma-finite  measure  relative  to  which  all 
the  measures  induced  by  F  are  absolutely  continuous,  the  usual  concept 
of  maximum  likelihood  estimation  cannot  be  applied.  The  general 
definition  of  MLE  due  to  Kiefer  and  Wolfowitz  (1956)  is  used  in  this 
section  to  determine  the  MLE  of  the  life-time  distribution  F  over 
[0,T),  where  F  e  F  and  data  arise  from  Testing  Plan  A.  It  is  also 
shown  that  this  MLE  is  strongly  consistent  as  n,  the  number  of 
original  items,  tends  to  infinity. 

In  this  section  let  d(n)  denote  the  total  number  of  distinct 
failures  in  [0,T)  in  the  combined  n  experiments.  Recalling  the’ 
notation  given  in  Section  2,  observe  that 

0  <  d(n)  <  £  (K  -1). 
r»l 

Also,  let  0  *  Zq  <  <  ...  <  6e  the  ordered,  distinct,  failure 

times  X^,  J  ■  1,  ...»  Kr-1,  r  »  1,  ...,  n.  Finally,  let  p(n)  be  the 
number  of  YR  r’s,  r  ■  1,  ...»  n,  strictly  greater  than 

5.2  Maximum  Likelihood  Estimate. 

In  this  section  we  shall  find  the  MUS  of  that  part  of  a  life-time 
distribution  F  e  F  over  the  interval  [0,T)  when  data  arise  from 

1*2 


*•**  *&*+*>?*+*  trwcr*if  ******  *  *» 


Testing  Plan  A.  The  following  general  definition  of  a  maximum  likeli¬ 
hood  estimate  is  due  to  Kiefer  and  Wolfowitz  (1956)  and  is  needed  to 
determine  the  MLE  of  F  e  F  for  the  two  reasons  mentioned  earlier. 

Definition  5.*> 

Let  3  be  a  sample  space,  8  a  o-field  on  n,  Pa  family  of  probability 
measures  on  B  and  e  a  set  indexing  the  elements  of  P  by  P( • |g) , 

9  c  0.  Let  X  be  a  random  vector  defined  on  fl  with  distribution  function 
determined  by  P(* |8q)»  eQ  e  0.  If  X^»  Xg,...,  &n  denotes  a  random 
sample  from  P(*  |eQ)  then  the  MLE  of  0^  is  0  if  6  e  0  and 

n  dP(X  je) 

n  — — - 

r-i  d(p(xrje)  ♦  p(xje)) 

sup  . . . — . . . .  .  *  1 

6e0  n  l  dP(Xr|0)  1 

r»l  \  d(P(Xr|0)  ♦  P(Xr|e))J 

where 

dP(-  |0X) 

d(P(*  |0X)  +  P(*  |02)> 

denotes  the  Radon-Nikodym  derivative  of  P(*|0^)  with  respect  to 
PH^)  ♦  P(-|e2). 

The  Kiefer  and  Wolfowitz  concept  of  MLE  will  now  be  considered  within 
the  framework  of  Testing  Plan  A  and  for  life-time  distributions  F  c  F. 

Let  fl  ■  (♦,  and  all  finite  sequences  of  non-negative  numbers  whose  sum 
is  leas  than  T),  where  $  is  the  empty  set.  Also,  let  »  (x  c  0 

m 

which  have  exactly  i  elements),  i  ■  0,  1 .  Then  fl  ■  U  X. .  .We 


define  a  set  A  to  be  measurable  in  ft  if  and  only  if  A  *  E  A.  and  A. 

i=0 

is  Borel  measurable  in  X^  Let  B  the  o-field  of  measurable  sets  in  ft. 

For  each  F  e  F  we  will  define  a  probability  measure  P( * | F)  on  B  and 

will  denote  the  collection  of  all  such  measures  by  P.  These  probability 

measures  will  be  defined  first  on  the  Borel  measurable  sets  of  each  X^. 

Some  preliminary  notation  is  needed.  Denote  by  X(*|i,  F)  the  product 

measure  on  R*  (Eucidean  i-th  space)  induced  by  F,  where  X ( • | 0 ,  F)  is 

defined  to  be  one.  Also,  recall  that  F(x")  ■  lim  F(x-e),  e  >  0,  and 

0  0  e— >0 

products  of  the  form  II  and  sums  of  the  form  2  are  1  and  0, 

J«1  J-l 

respectively.  For  each  Borel  measurable  set  A^CX^  and  F  e  F  define 
the  measure  P( • | F)  to  be 

i 

P(A.  |f)  =/  {1  -  Pdf-Ex, r»  dX(x|i,F). 

1  j»l  J 

For  any  A  e  8  we  define  P(A|f)  to  be 


P(A|F)  *  £  P(A  |F) 
i°0  1 

where  A^  »  AHX^. 

This  definition  is  motivated  by  the  integrand  of  equation  (2.7). 
Note  that  for  each  F  e  F 


P(n|F)  -P<  E  X.jF)  =  E  p(XJF) 
i«0  i-0 


=  E  Prob(K  =  i  +  l|F)  ■  1. 
i-0 

Thus,  for  each  F  t  F,  P( • | F)  is  a  probability  measure  on  B 

The  Kiefer  and  Wolfowitz  concept  of  maximum  likelihood  estimate 

together  with  our  definition  of  the  measures  P(*|f)  e  P,  F  e  F,  yields 
• ■ 

the  MLE  F  of  F  on  (0,T)  described  in  the  next  theorem, 
n 


Let  I(-)S)  be  the  indicator  function  of  S.  Also,  let  nr(y) 
denote 

kr 

Jx  Kirlr|ty.-)). 


Theorem  5.5 


The  MLE  F  of  F  has  failure  rate  r  where  r  ia  constant  over 
n  n  n 


lv  . ,d(n),  and 


rJZ  ) 


!  Krf  Kxjtv  2t» 

r-1  J»1  J 


ain 


n  4  d(n)+l>v>q+l  o<u<q  n  Zv 

[  /  n  (y)dy 
r-lZu 


(5.3) 


Proof: 

The  proof  of  this  theorem  follows  in  a  straightforward  manner 
froto  the  Kiefer-Wolfovitz  definition  of  MLE  using  the  probability  measures 
we  introduced  above  and  Brunk's  (1958)  results. 


Remark  5.6 


the 


We  will  now  give  a  useful  method  for  determining  r^.  Let  T^Q  be 
time  on  test  over  (Z  ,  Z  . )  (i.e.  T  ■  £  Jq+1  n  (y)dy),  q.  *  0,..., 

4  Q™X  Qu  n  • 


d<»).  if  (V1  <  (Tlor  i ...  <  (*4fa).r  th..  r,<y .  «•„>-*, 

q  ■  0,...,d(n).  If  for  some  i,  (T^)*1  >  <T^i+i)n>— ^  then  replace 
(T, J’1  «d  (Tr.^u)"1  ^  2(T4m  ♦  )*. 


V  q+i 

x-i 


r»l  Z. 


-1 


\”1 


‘in' 


l(i+l)n 


in  (i*l)n' 


If  a  reversal  still  exists,  replace  by  appropriate  averages.  That  is, 
if  2(Tin  ♦  T^^)*1  >  tohen  replace  (T4J'\  (Tj^J"1  and 


(i+2)n 


in' 


(i+l)n' 


(T(i+2)n)  1  by  3(Tin  *  T(i+l)n  +  T(i+2)n)  * 

Continue  averaging  whenever  there  is  a  reversal.  This  will  yield  the 

*0  «*  •* 

monotone  increasing  sequence  r( Zq)  1  rn(2^)  <_  ...  ±  rn^d(n) ^  given  (5.3). 
5.3  Strong  Consistency  of  Fn« 

The  main  result  of  this  section  is  that  the  MLE  of  F  on  (0,T) 

converges  uniformly  a.s.  to  F  as  the  number  of  items  put  on  test  at 

time  zero  increases.  To  accomplish  this  we  will  prove  a  convergence 

theorem  for  i*n(x),  xe[0,T),  rn(x)  defined  in  Theorem  5.5.  This 

result  will  allow  us  to  easily  prove  the  main  result  plus  several 

corollaries.  Furthermore ,  since  the  failure  rate  of  a  life-time  distribution 

is  an  important  practical  concept,  the  convergence  theorem  for  r^Cx) 

is  also  a  significant  practical  result. 

We  will  need  several  theorems  before  we  can  prove  the  convergence 

theorem  for  r  (x).  The  next  theorem  involves  rewriting  r (x),  given  in 
n  n 

Theorem  5.5,  in  a  form  we  need  to  show  consistency. 

K  -1 
n  r 

Let  R(u,v)  denote  l  l  I(X.  |(u,v))  and  S(u,v)  denote 

r-1  J-l  Jr 

l  j  n  (y)dy. 
r»l  n 

Theorem  5.7 

Let  xe[0,T)  and 

Z  (x)  =  max  {Z. j Z . <x} . 
n  0<i<d(n)  1  i~ 


Proofs 


-  *  -”W-y  -r . 


•x^X'.fyvi 


r  (x)  =  inf  sup  . 

n  x<v<T  u<Z  (x)  S(u»v) 

—  n 


(5.M 


Follows  directly  from  Theorem  5.5. 


To  show  consistency  of  rn  we  need  the  next  two  theorems.  Let 

n  V1 

n  r 


M>,v)  ™  &J£k 


I  [  «xJr|  [»,»)> 


n  v 
I  /  n  (y)dy 
r=l  u  r 


,  0  <  u  <  v  <  T, 


and  let  Ip  he  the  intersection  of  the  support  of  F  with  [0,T]. 
Theorem  5.8 

Let  0  <_  uQ  £  vQ  <_  T  be  fixed  where ,  0  <  uQ  <  T  if  Ip  ■ 

0  i  u0  *  v0  K  Bp  Jp  *  t«p»  Bpl*  Then,  as  n  » 

i)  Mn(uQ,v)  converges  uniformly,  a.s.,  in  vQ  v  <_  Tj 

ii)  Mn(u,vQ)  converges  uniformly,  a.s.  in  0  <  u  1  uq* 


Proofs 


Let  X^,  Xg,...,  he  a  sequence  of  independent,  identically 

distributed  (i.i.d.)  random  variables  with  c.d.f.  F,  F(0)  *  0.  Let 

N 

be  the  first  integer  such  that  £  X,  >_T,  N_  the  first  integer 

J  .1  *  ^ 


i»l 


such 


r  r3 

that  l  X,  >_  T,  N_  the  first  integer  such  that  l  X.>T, 

i-Nj+1  3  i-^+Ng+l 

and  so  on.  Then  is  a  sequence  of  i.i.d.  random  variables. 

Using  the  Glivenko-Cantelli  theorem  one  may  show  that  as  n  ■*  « 


Bn(u,v)  F(v”)  -  F(u”),  a.s.,  -«•  <  u  <  v  <  «, 


1*7 


(5.5) 


where 


Bn(u,v) 


N(n) 

1  I(X. | (u,v) ) 
^-.1  * 


,  H(n)  *  l  N  . 

r=l  r 


Also,  using  the  strong  lav  of  large  numbers  and  the  Glivenko- 


Cantelli  theorem  it  is  easy  to  show  that  as  n  +  » 


Cn(u,v)  — >  £jr|-y  (F1(v*)  -  F1(u‘)]  a.s. 


(5.6) 


for  -•  <  u  <  v  <  «,  where 


Cn(u,v) 


II(V.rlIu>v)) 

-  ,  A(n)  ■  l  K  » 

A(n)  r*l  r 


and  F. 


2  is  the  c.d.f.  of  We  may  conclude  from  (5.5)  and  (5.6) 


that  as  n  -*  <* 


Dn(u,v)  «  Bn(u,v)  -  Cn(u,v) 


converges  uniformly,  a.s.  for  -«  <  u  <  v  <  •. 


Similarly  one  may  show  that  as  n  +  » 


(5.7) 


Sn(u,v)  converges  uniformly  a.s.  on  0  £  u  <  v  <  T  (5.8) 


where 


n  v 

I  /  ".(ylay 

su(u-v)  *  ~ -VnT- 


Also,  observe  that  for  nQ  sufficiently  large, 

(Sn(u0,v))  1  is  uniformly  bounded,  a.s.,  (5.9) 

onv0<_v<T,  n>nfl, 

Dn^u0’v^  is  unifor®ly  bounded,  a.s.  (5.10) 

°nv0<.v<T,  n>nQ 

<Sn<u»vo)rl  ia  unifonBly  bounded,  a.s.  (5.11) 

°n  0  <  u  <  uQ,  n  >_  nQ,  and 

Dn(u,v0)  is  uniformly  bounded,  a.s.  (5.12) 

on  0  i  u  i  u0»  n  >  nQ. 

The  proof  is  completed  since  (5.7)  -  (5.10)  imply  (i)  and  (5.7), 
(5.8),  (5.11)  and  (5.12)  imply  (ii). 

Theorem  5.9 

Let  P  be  IFR  on  (0,T)  with  failure  rate  r  on  [0,T).  Then,  for 
0  <_  u  <  v  <  T  fixed,  where  0  <  u  <  6  if  I_  ■  [o,0], 

K-l 

E(  l  KXJlu.v))) 

r(u)  <  - <r(v)  (5.13) 

E(J  n(y)dy) 
u 

where  K  «  5^,  n(*)  «  1^(0  and  ^  -  X^,  i  -  1,2 . 

1*9 


r 


Proof: 

If  Ip  »  ^  then  F  has  failure  rate  0  on  [0,T)  and,  thus,  (5.13)' 
follows.  If  Ip  «  (g>  then  F( B )  *  1.  Consequently,  r(x)  =  ®,  x  ^  3,  and 
r(x)  *  0,  x  <  g.  Also, 


K-l 

E(  l  I(X, |(u,v)))  »  0  f6r  u  <  v  <  g 
i*l  1 

and 

K-l 

E(  I  I(X. |(u,v)))  >  1  for  u  <  g  <  v. 
i»l  1 

Further, 

v 

E (/  n(y)dy)  >  0  for  u  <  g. 
u 

Thus,  (5.13)  easily  follows  when  Ip  a  {g}. 


Bow,  assume  Ip  «  [o,g),  0  <_  a  <  g  <  T.  Also,  recall  that  by  Theorem 
U.3,  we  know  that  if  H  is  a  e.d.f.  with  failure  rate  constant,  say,  X,  on 
[a,b),  then 

K-l 

Ejj(  l  I(X1|ta,h))) 

~ -  •  X.  (5.1*0 

y/  n(y)dy) 
a 

Case  1. 

0  <  u  <  v  <  g. 

If  F  has  a  nondecreasing  step-function  failure  rate  on  [u,v) 
then  (5.13)  holds  by  a  simple  application  of  (5.1*0.  To  prove  that 
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't  *******  ->*rV9t  -** 


(5.13)  holds  in  general  for  this  case,  let  rn(x),  n  *  1,2,..., 
xe[0,8)  he  a  sequence  of  real  valued  functions  such  that  ra(x)  *  r(x), 
xc[0,u),  rR(x)  is  a  nondecreasing  step-function  on  [u,v)  and 
rn(x)  t  r(x)  on  [u,v).  Note  that  rn(x)  <_ r(x)  <_ r(v)  <  ».  Thus, 
hy  the  Lebesgue  Dominated  Convergence  theorem,  as  n  -*•  * 

y  y 

J  r  (x)dx  -*•  /  r(x)dx,  y  e  [0,v). 

0  n  0 

Therefore , 

y  y 

F  (y)  =  1  -•  exp{-J  r  (x)dx)  -*•  1  -  exp{-J  r(x)dx} 
n  0  n  0 

*  F(y),  y  e  [0,v),  as  n  ♦  •  . 


Let  Fn(y)  ■  F(y),  y  >,  v.  Then  Fn>  n  ■  1,2,...,  is  absolutely 
continuous  on  [0,v),  continuous  from  the  right  on  [v,»),  since 
F  is,  and  Fn(0)  ■  0,  Fn(*»)  ■  1.  Thus,  Fq  is  a  sequence  of  distribution 
functions,  FQ(y )  -*•  F(y),  y  e  (-•»,•),  as  n  ».  Let 

k-1  k 

Sk  3  i  l  \  <  T.  I  \  >  *).  k  *  1,2 . 

*  i»l  1  i»l  1 


By  the  Helly-Bray  theorem  (Loeve  (1963)) 


P[K*k|Fn]  » 


k  k 

/•••/  n  dF  (x,  )■>/•••/  n  dF(x.) 

Sk  i-1  sk  i-1 


*  PtK"k|F],  n  ■*  »,  k  ■  1,2,...  .  (5.15) 
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Let  Pn(k)  -  P[K*k|Fn],  n  *  1,2,...,  k  *  1,2,...,  and 

p(k)  »  P[K*k|F],  k  *  1,2,...  .  Sy  Rao  ((1968),  page  106)  and 
(5.15) 


I  |p„(k)  *  P(kH  0,  n  •*  ». 

k*0 


Now,  note  that 


K-l 


and 


l  l(X.  |  (u,v))  <_  [~],  a. s.,  u  >  0 
i=l  1  u 


n(y)  <.  [£■],  a.s. ,  y  >  0 
y 


where  [x]  denotes  the  largest  integer  less  than  or  equal  to  x. 
Thus,  since  u  >  0  and  (5.16)  holds 


K-l  K-l 

|Ep  (  l  Kxjtu.v)))  -  y  l  l(Xi|[u,v)))| 


n  i«l 


i»l 


*11/  l  Kx.Ku.v))  n  dF  (x.) 
k-l  ^  i-1  1  J*1 

00  k 

'III  I(x.|[u,v))  n  dF(x. ) | 
k-l  ^  i»l  1  J-l 


<  [^]  l  |p  (k)  -  P(k)|  0,  cs  n  +  ®. 

k-l 


Also, 


t  T 

/  n{y)dy  <_  (v-u)  n(u)  <_  (v-u)[-] 


(5.16) 

(5.17) 

(5.18) 
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h  '*»'*'* '  *  '  'fc>#  '  T7*** ''  1  ^  v 


by  (5.16).  Hence, 


K-l  K-l 

Ep  (  l  Kxjlu.v))  •*•  Ep(  l  I(Xi|[u,v))) 


(5.19) 


n  i=l 


i=l 


and 


v 

Ep  (/  n(y)dy)  •*•  Ep(/  n(y)dy) 
n  u 


(5.20) 


However,  from  (5,11*)  it  follows  that 

K-l 

Ej,  (  l  KXjtu.v))) 

r„W«-^ - <_rnM. 

Ep  (/  n(y)dy) 
n  u 

Taking  limits,  and  using  (5. 19)  and  (5.20)  gives  (5.13). 


Case  2. 


0  ■  u  <  v  <  e. 


Inequalities  (5.13)  follows  easily  using  the  results  of  Case  1. 

Also  it  is  straightforward  to  use  the  results  of  Case  1  to 
prove  (5.13)  for 


Case  3. 


S  <  T,  B  <,  v  <  T. 


We  now  give  the  convergence  theorem  for  the  estimate  rn(x)  of 
r(x),  0  <_  x  <  T. 


53 


**«**/«» 


'  •*'r  *  *■  ri'n 


Theorem  5.10 

Let  F  he  IFR  on  [0,T)  with  failure  rate  r  on  [0,T). 

Then, 


r{x“)  <  lim  inf  rn(xQ)  <  lim  sup  ^(xq)  <  r(xj)  a.s. 


for  each  xQ  c  (0,T). 


Proof: 

Case  1. 


h  * 

In  thi*  case  rQ(x)  *  0  a. a.  for  0  <  x  <  T.  Since  r(x)  *  0, 

0  <_  x  <  T,  the  result  follows. 

Case  2. 

Ip  ■  (a, 8]. 

^t  W  "  ■“  <ZJZ<  i*n>’  We  »hw  the  right-hand 
0<i<d(n)  110 

inequality  firstT 

If  8  <  T  and  6  <.  xQ  <  T,  then  r(Xg)  »  •»,  since  F(8)  »  1. 

Hence,  assume  0  <  xQ  <  8  <.T.  Choose  v^,  x^  <  <  8.  Then 

r_(xft)  *  inf  sup  M  (u,v) 

*0<v  u<Zn(xQ)  n 

<  sup  M  (u,v0).  (5.21) 

U<VX0> 


5k 


'Vi 


Let 

V1 

E(  l  iCX^jta.b)) 

M(a,b)  «  --1*1  — —  ", . .  -  . 

£(/  n,(y)dy) 
a 

Since  0  <  Xq  <  Vq,  we  may  apply  Theorem  5.8  (ii)  and  conclude 
that  as  n  -*■  •  Mn(u,vQ)  converges  uniformly  a.s.  for  0  <  u  < 

Thus,  for  arbitrary  e  >  0  and  n  >_  N(c),  soy, 

r_,(xn)  i  8U?  (M(u,v  )  +  e). 

U<W  0 

Since  u  <  B  we  may  apply  Theorem  5.9  and  conclude  that 
lim  sup  rn(xQ)  1  r(vQ)  +  c.  This  gives  lim  sup  rQ(xJ  <_  r(x*) 
a.s.  since  xQ  <  v  and  the  right-hand  limits  exist. 

We  vill  now  show  the  left-hand  inequality. 

Case  2a. 

0  <  a  and  xQ  e  (0,o]. 

Since  r(Xg)  *  0  the  left-hand  inequality  holds. 

Case  2b. 

0  <  T  and  0  <  xQ  <  T. 

If  P  takes  a  Jump  at  6  then  with  probability  one  Zr(xq)  ■  0 

for  n  >  N,  N  sufficiently  large.  But  this  implies  that 

r„(x)  »  r  (0)  ■  •  for  n  >  K,  0  <  x  <  T.  Thus.,  lim  inf  r„(xn)  *  • 

and,  hence,  lim  inf  r(xn)  >  r(x!T). 

no—  o 


If  F  does  not  take  a  jump  at  0  then  r(g~)  =  »  and  therefore 
as  n  +  ®  Zn(xQ)  ®  a*8**  Choose  uQ,  0  <  uQ  <  °°.  Then  for  N 
sufficiently  large,  uQ  <  zn(*0)  <  6*  for  n  >_  N,  and,  thus, 

r  (xj  *  inf  sup  M  (u,v) 


>  inf  M  (uq,v) 
X0—V 


,  1  inf  Mn(uQ,v)  for  uQ  <  vq  <  0. 


Apply  Theorem  5*8  (i)  and  conclude  that  for  arbitrary 
e  >  0,  N(e)  sufficiently  large, 

r  (xQ)  1  inf  (M(u_,v)-e)  a.s. ,  n  >  N(e). 

Vv 

By  Theorem  5*9.  rn(xQ)  —  r^u0^  “  c*  n  ~  11118  give8 

lim  inf  rn(xQ)  >.  r(uQ)  a.s.  for  all  uQ  <  0.  Letting  uQ  0~ 
gives  lim  inf  r  (xA)  =  «  a.s..  Since  r  (x”)  ■  ®  for  xn  >  0, 
we  have  the  desired  result  for  Case  2b. 


Case  2c. 


a  c  XQ  c  0  £  T. 


Choose  Uq,  a  <  uQ  <  x^.  Then  for  N  large  enough  so  that 


uo  4  W  4  V 
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r  (xj  =  inf  sup  M  (u,v) 

“  0 

>  inf  M  (x-.v). 

X(>iv 

Applying  Theorems  5*8  and  5-9  in  the  usual  manner  gives 
lim  inf  i*n(x0)  L  r(u0)  a,s*  for  ^  a  <  uo  <  x0‘  ^ 

result  follows. 

This  completes  the  proof. 

The  main  result  of  this  section  is 


Theorem  5.11 

Let  F  he  IFR  on  [0,T)  with  failure  rate  r  on  [0,T).  Then 

F  (t)  -*■  F(t)  uniformly  a.s.  in  te[0,T),  where 
n 

„  z*t 

Fn(t)  *  1  -  exp(-J  rn(y)dy). 

Proof: 

Let  I_  be  the  support  of  F  on  [0,T].  If  Ir  =  $  the  conclusion 
r  r 

is  clearly  true.  Note,  axso,  that  F^CO)  =  0  a.s..  Suppose  then  that 

I  *  [a, 6].  By  Theorem  5*10  r  (t)  •*  r(t),  t  e  [0,S)  except  possibly 

r  n 

on  a  set  of  Lebesque  measure  zero.  Let  t  e  [0,$)  and  let  t  <  t^  <  0 
be  a  continuity  point  of  r.  For  arbitrary  e  >  0  and  N  =  N(tQ,e) 

sufficiently  large,  rfi(x)  Jl  rn(tg)  —  *  e  *’or  x  E  ^»t],  n  L  N* 

Thus,  by  the  Lebesque  Dominated  Convergence  theorem 

t  „  «t 

f  rn(z)dz-^f  r(z)  dz  a.s.  (5.22) 
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Since 


t 

F(t)  =1  -  exp(-J  r(z)dis),  t  c  [0,8), 

0 

(5.22)  implies  that 

Fn(t)  F(t)  a.s.  t  e  [0,3) .  (5.23) 

Caae  1. 

F  is  continuous  on  [0,T). 

Since  Testing  Plan  A  and  all  related  random  variables  are 
uneffected  by  the  behavior  of  F  on  (T,®) ,  we  may  assume  without 
any  loss  of  generality  that  F  is  continuous  on  [0,T]. 

Case  la. 

F(T)  «  1,  J  «  T. 

«  «•  •» 

Extend  Fn  to  (-«,•)  by  defining  Fn(x)  ■  0,  x  <  0,  Fr(x)  »  1, 

x  >_T,  Then,  by  (5.23)  as  n  * 

•» 

FQ(t)  F(t)  a.s.  t  e  (-",«).  (5.2*0 

•* 

Note  that  F  is  a  distribution  function.  Since  F  is  continuous  on 
n 

•» 

(■*»•)»  FQ(t)  *  P(t)  uniformly  a.s.  t  c  (-*,»),  as  n  «*■  •  by  Polya's 
theorem  (Eisen,  1969). 

Case  lb. 

F(T)  <  1,  6  «  T. 

Since  1-F(T~)  >  0,  there  exists  a.s.  some  m  =  1,2,...,  such  that 
Kjh  ■  1.  This  implies  that  either  d(n)  ®  0,  or  p(n)  >  1  and  d(n)  >^1, 
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for  n  >  a.  In  any  case,  r  (x)  <  »  a. a.  x  c  [0,T),  for  n  >.m. 

—  n  . 

•#  •* 

Therefore,  Fq(x)  <  1,  x  c  [0,T),  and  hence,  FQ  may  he  extended  to 

[0,T]  in  a  continuous  manner,  for  n  >.  m.  Since  F  is  continuous, 

Fn(T)^F{T).  Lot 


F  <x) 

n 

F  (T) 

x  e  £0,T] 

n 

1 

x  e  (T,«») 

0 

k 

x  e  (-*,0) 

for  n  >  a,  and  let 


(5.25) 


G(x) 


'Pixl 

F(T) 


1° 


x  c  [0,T] 

x  c  (T,-) 
x  e  (-“,0)  . 


(5.26) 


Then  G  ,  n=m,  m  +  l,...,G  are  distribution  functions,  G  is 
n 

continuous  and  Gfl(x)  G(x)  a. 3.  x  e  By  Polya's  theorea 

•» 

the  convergence  is  uniform.  Since  F  (T)  is  bounded  for 

n 

n  ■  a,  a  +  1,...,  this  implies  that  FQ(t)  *  F(t)  uniformly  a. a. 
t  t  (0,T),  M  D  +  ». 


Case  lc. 

6  <  T. 

Let  0  <  x  <  T  and  c  >  0  be  given.  By  the  continuity  of  F  there 

exists  a  0  <  z  <  8  such  that  l-F(z)  <_  e,  and  by  (5.24)  there 

•* 

exists  a  N  *  N(z,e)  s\»ch  that  F(z)  -  c  <.?n(*)*  n  R.  Hence, 

for  n  >  N,  1  -  2e  <  F(z)  -  c  <  F  (*)  <  F  (x)  <  1.  Therefore, 

—  —  —  n  —  n  — 
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I 


lim  F  (x)  F(x)  =  1  a.s.  for  x  >.  8.  Using  (5.2U)  we  have 
n-*» 

F  (x)  -*•  F(x)  a.s.  for  xe[0,T).  Using  Polya's  theorem  again  we  may 
n 

conclude  that  Fn(x)  F(x)  uniformly  a.s.  for  xe[0,T),  as  n  +  ». 

Case  2. 

F  takes  a  jump  on  [0,T). 

Since  F  takes  a  jump  on  [0,T)  at  3,  it  follows  that  with  probability 
one  =  1,  for  some  m  =  1,2,...  .  Thus,  rR(t)  =  »,  3  <,  t  <  T,  n  _>  m, 
which  implies  that  Fn(t)  =  1,  S  ^t  <  T,  n>  m.  Since  F(t)  s  1,  t  >  Si 
we  have 

Fn(t)  ->  F(t)  uniformly  a.s.  t  e  [B,T),  as  n  -*■  ».  (5.27) 

We  will  now  show  that  the  convergence  is  uniform  on  [0,T).  For  n  _>  m, 

Fq  is  a  sequence  of  nondecreasing,  bounded,  continuous  functions.  Hence, 
they  may  be  extended  to  [0,8]  in  a  fashion  which  will  preserve  continuity. 
Similarly,  we  may  extend  F  to  [0,8]  in  a  continuous  manner.  By  (5.23), 

FR(t)  ■*  F(t),  te[0,8),  as  n  +  ».  Let  F*(8),  F* ( 0 ) ,  be  the  extended 
values  of  Fr  and  F  for  n  _>  m.  It  is  straightforward  to  show  that 
F*(8)  -*■  F*(B)  a.s.  as  n  +  ®.  Now,  let 

F  (x) 

F*Te7 

1  x>  3, 

0  x  <  0 


F(x) 

,Wi) 


o  <  x  <  e. 


x  >  8, 

x  <  0 


for  n  >  m.  Note, then,  for  n>  n,  Hn,  H  are  continuous  distribution 

functions,  and  H  (x)  H(x)  a.s.  Applying  Polya's  theorem  again  we 
n 

may  conclude  that  H  (x)  H(x)  uniformly  a.s.,  xe(-»,»),  as  n  +  ~.  Then 
'  n 

F  (x)  F(x)  uniformly  a.s.  xc[0,B),  as  n  •».  (5.28) 

n 

Thus,  (5.27)  and  (5.28)  give  the  desired  result.  This  completes  the 


proof. 


We  now  give  two  useful  corollaries  of  Theorems  5.10  and  5.11. 


Corollary  5.12 

Let  S  ■  (u,v]  be  a  closed  interval  of  continuity  of  r, 

0  i  u  *  v  <  T.  Then,  rn(x)  r(x)  uniformly  a.s.  on  S  as  n  ■*  ®. 


Proof. 


By  Theorem  5.10 


r  (x)  •*  r{x)  a. 8.  on  8  as  n  +  », 
n 


(5.29) 


Casel, 


r(u)  ■  r(v)  >_  0 

For  N  sufficiently  large 


6l 


*»»n* 


r(u)  -  c  <  r  (u)  <  r(u)  +  e 

—  n  — 

and 

r(v)  -  c  <  r„(v)  <  r(v)  +  e. 

—  n  — 

But 

r  (u)  <  r(x)  <  r„  (v). 
n  —  n  —  n 

The  result  follows . 


Case  2. 

r(v)  >  r(u). 


Let 


V*> 


(KM  -  rn(u) 

r  (v)  -  r(u) 
n  n 

0 


\1 


U  <  X  <  V 

X  <  u 
X  >  V 


n  *  1,2,...,  and  let 


r(x)  -  r(u 
r(v)  -  r(u) 


U  <  X  <  V 


D(x)  » 


o  *<u 

'1  X  >  V 

Note  that  D  ,  D  are  distribution  functions  and  D  is  continuous, 
n 

Applying  Polya's  theorem  (Eisen  (1969))  and  (5.29)  gives 


1 

I 

1 


i  ■ 

h 


i 

J 


i 

I 

I 
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Dn(x)  •>  D(x)  uniformly  a.s.  on  (-«,*)  as  n  •*■  «.  For  x  e  S,  the 
sequence  (rn(x)},  n  >_ 1  is  ultimately  uniformly  bounded .  This  implies 
that  rR(x)  •*  r(x)  uniformly  a.s.  on  S  as  n  -*■  •».  The  proof  is  completed. 

Corollary  5.13 

Let  S  =  [u,v]  be  a  closed  interval  of  continuity  of  r,  0  £u  <  v  <  T. 

Then, 

as 

fQ(x)  f(x)  uniformly  a.s.  on  S  as  a  +  • 

.  .  x 

where  fn(x)  «  rn(x)  exp (-/  rn(y)dy). 

Proof: 

The  proof  follows  directly  from  Theorem  5 •!!  and  Corollary  (5 .12). 
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